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Abstract. Let X be an irreducible smooth projective curve, of genus at least two, de- 
fined over an algebraically closed field of characteristic different from two. If X admits a 
nontrivial automorphism a that fixes pointwise all the order two points of Pic°(X), then 
we prove that X is hyperelliptic with a being the unique hyperelliptic involution. As a 
corollary, if a nontrivial automorphisms a' of X fixes pointwise all the theta character- 
istics on X, then X is hyperelliptic with a' being its hyperelliptic involution. 



1. Introduction 

Let Y be a compact connected Riemann surface of genus at least two. Assume that 
there is a nontrivial holomorphic automorphism 

a : Y — > Y 

satisfying the condition that for each holomorphic line bundle £ over Y with £® 2 trivi- 
alizable, the pull back <Tg£ is holomorphically isomorphic to £. In [2] it was shown that 
Y must be hyperelliptic and <To is the unique hyperelliptic involution (see [2J p. 494, 
Theorem 1.1]). 

We recall that a theta characteristic on Y is a holomorphic line bundle 9 such that 9® 2 
is holomorphically isomorphic to the homomorphic cotangent bundle Ky . The group of 
order two line bundles on Y acts freely transitively on the set of all theta characteristics 
on Y. From this it follows immediately that if an automorphism of Y fixes pointwise all 
the theta characteristics, then it also fixes pointwise all the order two line bundles on Y. 
Therefore, if Y admits a nontrivial automorphism a' that fixes pointwise all the theta 
characteristics on Y, then Y is hyperelliptic and o~' is its unique hyperelliptic involution. 

The proof of Theorem 1.1 in [2] is topological. Here we investigate the corresponding 
algebraic geometric set-up, where the topological proof of Theorem 1.1 in [2] is no longer 
valid. 

Let X be an irreducible smooth projective curve defined over an algebraically closed 
field k. We will assume that genus(X) > 1 and char(A;) ^ 2. We prove the following: 

Theorem 1.1. Let 

a : X ► X 

be a nontrivial automorphism that fixes pointwise all the theta characteristics on X . Then 
X is hyperelliptic with a being its unique hyperelliptic involution. 
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This theorem is proved by showing that if 

a' : X — > X 

is a nontrivial automorphism of X that fixes pointwise all the order two points in Pic°pf ), 
then X is hyperelliptic with a' being its unique hyperelliptic involution. (See Lemma [37X1 ) 

It should be pointed out that Theorem 11.11 is not valid if the assumption that the field 
k is algebraically closed is removed. There exists a geometrically irreducible smooth pro- 
jective real algebraic curve Y of genus g > 2 which admits a nontrivial involution a that 
fixes pointwise all the real points £ G Pic 9_1 (F) with £ (g>2 = Ky, and genus(Y/ (a)) ^ 0. 
(The details are in pp.) 

2. Automorphisms of polarized abelian varieties 

Let k be an algebraically closed field whose characteristic is different from two. Let A 
be an abelian variety defined over k and L an ample line bundle over A. For any positive 
integer n, let 

(1) A n c A 

be the scheme-theoretic kernel of the endomorphism A — > A defined by x i — ► nx. 
Proposition 2.1. Let 

r : A — ► A 

be a nontrivial automorphism such that t*L = LQQLq for some L$ G Pic°(A), and the 
restriction of r to the subscheme A no (see Eq. (JTJ^ is the identity map for some n > 2. 
Define the two endomorphisms 

f± := Id A ±r : A — > A. 

Let A + (respectively, A_) be the image of f + (respectively, Then 

(1) n = 2. 

(2) r 2 = t o r is the identity automorphism of A. 

(3) The natural homomorphism 

(2) : A + x A_ — ► A 

defined by the inclusions of A + and in A is an isomorphism. 

(4) The pull back (3*L is of the form p* + L + (£)p*_L_, where p + (respectively, p_) is the 
projection of A + x A_ to A + (respectively, A-). 

Proof. A proof of statement (1) is given in [H p. 207, Thoerem 5]. See j3j p. 120, 
Corollary 1.10] for a proof under the assumption that k is the field of complex numbers. 

To prove statement (2), we will show that the restriction of r 2 to A 4 is the identity 
map. Take any point x G A4. Then t(2x) = 2x because 2x G A<i. Hence t(x) = x' + x 
for some x' G A?,- Thus 

t(t(x)) = t(x' + x) = t(x')+t(x) = x' + (x' + x) = x. 
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Consequently, the restriction of r 2 to A4 is the identity map. Now statement (2) follows 
from statement (1). 

To prove statement (3), consider the composition homomorphism 

A f ±%- A + xA_ M A, 

where f3 is the homomorphism in Eq. (j2J). It coincides with the endomorphism of A 
defined by x 1 — > 2x. We also note that A2 C kernel(/ + x /_). Hence 

(3) kernel^ o (/ + x /_)) C kernel(/+ x /_) . 

Since r 2 = Ha, the composition / + o /_ is the zero homomorphism. Hence dim(A + x 
A J) < dim. A. Now From Eq. (j3J) it follows that (3 is an isomorphism. 

To prove statement (4), let 

<pp* L : A + x A_ — > Pic°(A+ x AJ) = Pic°(A+) x Pic°(A_) 

be the homomorphism that sends any /c-rational point x G A + x A_ to the line bundle 
(t*/3*L) (£) (3*L*, where t x is the translation map of A + x A_ defined by y 1 — ► y + x; see 
[U p. 131, Corollary 5] for a precise definition of the morphism <pj3*L- Let 

t' := Id A+ x (-ld A _) 

be the automorphism of A + x A_ . We note that the isomorphism /3 in Eq. (|2j) takes r to 
r'. 

Let 

t := Id Pic o (A+) x (-Id Pic o (j4 ) ) 

be the automorphism of Pic°(A+) x Pic°(A_) = Pic°(A + x A J. Since t*L = L(g)L 
for some L e Pic (A), the following diagram is commutative 

A + xA. ^J Pic°(A + ) x Pic°(A-) 



t' 



A + xA. ^ Pic°(A+) x Pic°(A-) 

Therefore, the homomorphism 4>p*L takes the subgroup A + (respectively, A J) of A + x A_ 
to the subgroup Pic°(A + ) (respectively, Pic°(A_)) of Pic°(A + ) x Pic°(A_). Now from the 
injectivity of the homomorphism 

NS(A+ x A J — ► Hom(A+ x A_ ,Pic°(A+) x Pic°(A_)) 

defined by £ 1 — > 0^ it follows immediately that the Neron-Severi class of (5*L coincides 
with that of some line bundle of the form p* + L + (^p*_L^ (see jH p. 178] for the injec- 
tivity of the above homomorphism). Therefore, statement (4) follows using the fact that 
Pic°(v4 + ) x Pic°(v4_) = Pic°(v4 + x AJ). This completes the proof of the proposition. □ 
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3. Automorphisms and theta characteristics 

Let X be an irreducible smooth projective curve, of genus at least two, defined over 
the field k. 

Lemma 3.1. Let 

a : X ► X 

be a nontrivial automorphism of X that fixes pointwise all the order two points Pic°(X)2 C 
Pic°(X). then X is hyperelliptic with a being its unique hyperelliptic involution. 

Proof. Let Pic d (X) denote the moduli space of line bundles over X of degree d. Let g 
denote the genus of X. On Pic 9_1 (X), we have the theta divisor given by the locus of 
the line bundles admitting nontrivial sections. Fix a fc-rational point x £ X. Let L be 
the pull back of the line bundle Fic g-i, x \(Q) by the morphism Pic°(X) — > Pic 9 ~ (X) 
that sends any ( to ( (£) Ox((g — l)^o)- 

Let r : Pic°(X) — > Pic°(X) be the automorphism defined by ( i — > er*£. This 
r satisfies the conditions in Proposition 12. 1L Hence r is an involution (see Proposition 
12.1( 2)). This implies that a is an involution. 

A hyperelliptic smooth projective curve Y of genus at least two admits a unique in- 
volution cry such that genus (Y/(ay)) = 0. Therefore, to complete the proof of the 
lemma it suffices to show that genus(X/ (a)) = 0. We note that the theta divisor 9 on 
Pic s_1 (X) is irreducible. Indeed, it is the image of Sym 9_1 (X) by the obvious map. Also, 
/i o (C Pic 9-i(x)(0)) = 1 because 9 defines a principal polarization. 

On the other hand, any ample hypersurface of the form (A + x DJ) \J(D + x AJ) on 
A + x A^ is never irreducible unless at least one of A + and A_ is a point; here D + (re- 
spectively, DJ) is a hypersurface on A + (respectively, AJ). Therefore, from statement 
(4) of Proposition 12.11 and the irreducibility of O we conclude that either dim A + = or 
dimA_ = 0. But dimA_ = genus(X) — genus (X/(cr)), and dim A + = genus(X/(cr)). 
Since genus(X) > genus (X/ (a)), we now conclude that genus(X/(a)) = 0. This com- 
pletes the proof of the lemma. □ 

A line bundle 9 is called a theta characteristic of X if 6 1 ® 2 is isomorphic to the canonical 
line bundle Kx of X. The space of theta characteristics on X is a principal homoge- 
neous space for Pic°(X) 2 . Therefore, if an automorphism a of X fixes pointwise all the 
theta characteristics on X, then a fixes Pic°(X) 2 pointwise. Consequently, the following 
theorem is deduced from Lemma 13.11 

Theorem 3.2. Let o : X — ► X be a nontrivial automorphism that fixes pointwise all 
the theta characteristics on X . Then X is hyperelliptic with a being its unique hyperelliptic 
involution. 

References 

[1] Biswas, I., Gadgil, S.: Real theta characteristics and automorphisms of a real curve. Preprint 
(2007) 



AUTOMORPHISMS OF CURVES 



5 



[2] Biswas, I., Gadgil, S., Sankaran, P.: On theta characteristics of a compact Riemann surface. 
Bull. Sci. Math. 131, 493-499 (2007) 

[3] Lange, H., Birkenhake, C: Complex abelian varieties. Grundlchrcn der Mathematischen Wis- 
senschaften, 302. Springer- Verlag, Berlin, 1992 

[4] Mumford, D.: Abelian varieties. Tata Institute of Fundamental Research Studies in Mathemat- 
ics, No. 5, Oxford University Press, London, 1970 



School of Mathematics, Tata Institute of Fundamental Research, Homi Bhabha Road, 
Mumbai 400005, India 

E-mail address: indranilOmath. tif r .res . in 



School of Mathematics, Tata Institute of Fundamental Research, Homi Bhabha Road, 
Mumbai 400005, India 

E-mail address: paramOmath. tif r . res . in 



